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\ study examined whether (1) the performance of 
students on text explicit (TE), text implicit (TI), and script 
implicit (SI) questions inserted in a text would vary as a function 
of the type of question received; (2) students responding in writing 
to the inserted questions would perform at a higher level on a 
subsequent criterion test than those responding covertly or mentally; 
(3) student performance levels would be higher on a multiple choice 
recognition test than on a short answer recal] one; ^nd (4) patterns 
of student performance would remain constant across developmental 
levels. Subjects were 97 fourth grade and 102 eighth grade students 
who read a 600-word passage, responded to questions in either the TE, 
TI , or SI condition, and completed a reading comprehension posttest. 
Students in the overt condition were asked to write their responses 
to the inserted questions, while those in the covert condition were 
told only to think carefully about their responses. The reading 
comprehension posttest questions were prepared in either a short 
answer or a multiple choice format. Results showei no interaction 
between inserted question and test question type, and eighth grade 
students performed better in the overt condition than did fourth 
grade students. In addition, it was found that student performance 
was higher on recognition than on recall tasks and that performance 
patterns did not remain constant across developmental levels. (FL) 
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The Effect of Response and Type of Posttest on Understanding of 

and Memory for Text 

Rothkopf noted tnat while one can lead a horse to water, the only 
water that gets into its stomach is what it dnnks; reminding 
researchers of the importance of investigating "drinking behaviors," 
i.e., what students do in learning situations (Rothkopf, 1970). Indeed, 
it seems apparent that the focus within the adjunct question paradigm 
has shifted from studies having a "variables" orientation to research 
having a "processing" orientation (Rickards &Denner, 1978)« While 
earlier studies have examined the effects of manipulating question posi- 
tion and frequency on text comprehension, current research tends to 
focus on processing induced by adjunct questions. Thus, there is now 
more interest in the influence of adjunct questions on the encoding, 
organization and retrieval of text information. 

Two factors that may influence these processes are: (1) the types 
of questions inserted in text and (2) the type of response required for 
answering these questions. A third factor that may influence the 
retrieval of text information is the test response mode. The purpose of 
this study is to examine the influence of these three factors on prose 
learning. Recent studies have suggested that question type may be as 
infli'ential on prose learning as question position (Carrier & 
Fautsch-Patndge, 1981). However, an obvious problem with tr.e research 
examining different kinds of questions has been that of definitions and 
categories. Generally researchers have supposed that certain questions 
require more work or deeper processing than others and have selected 
questions that vary in level or degree of required cognitive activity 
(Frase, 1969, 1970, 1971; Friedman & Ricka^^Js, 1981; Mayer, 1^75; 
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McCoHKie, Rdyner, & Wilson, 1973; kiC^^ards, 197^; Rickards & DiVesta, 
1974; Watts & Anderson, 19" i). 

For example, factual questions ^ave been compared with inferential 
questions (Frase, 1971); knowledge questions with comprehension 
questions (Sanders, 1973); lower order questions with higher order 
questions (Snavelson, Berliner, Ravitch, & Loedmg, 1974), and verbatim 
questions with comprehension questions (FeUer & Dapra, 1975), to cite 
just a few* The diversity of questions used makes interstudy com- 
parisons difficult and provides little general i zabl e information 
(Carrier S Fautsch-Patridge, 1981). What is needed is a taxonomy of 
questions that^ addresses the notion of question levels and is able to 
predict their effects on processing. The lack of such a taxonomy is a 
major obstacle to adjun^: question research. A similar problem is also 
encountered within the levels of processing research wherein a taxonomy 
of orienting tasks is needed. In both instances, the difficulty rests 
in the fact that we are unable to observe what occurs in the head of the 
learners and thus are unable to quantify such reader variables as orga- 
nization, breadth of background knowledge, question-answering skills, 
motivation, and tne l^ke. 

In addition to detimng levels of questions, a taxonomy of 
Questions should accomodate the complex tnree-wa>' interaction among 
question, tne text to which it fffen. , and tne knowledge base of the 
r^i^d^j . We Hdv'e nioved closer to thol goal wnri the -ntroduction of a 
taxonomy of questions by Pear^3Dn and Johnson (i^^78) whicl identifies 
questions on tne basis uf this tnret'-wdv rei at i onshi p, Tneir three 
Cdtegory tdxu''.omy mcljoes te^t e^plic-'t (U), '.c*;t rriplirit (11), eno 
^-cr^pt ii.;liCTt (SI) que^.ti^rs. 
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In a TE question-answer relationship (QAR), the constituents used 
to create the question and those used to respond appropriately are 
located within a single sentence of a text (e.g., Mary wore a scarf to 
school. Who wore a scarf to school? Mary). In a TI QAR the consti- 
tuents used to form the question and those used to respond appropriately 
are both located in the text, but require the integration of information 
across sentences, paragraphs, or pages. In an SI QAR the question is 
text-based but the appropriate response information is a part of the 
reader's knowledge base; the text does not provide adequate information 
for the response. While this taxonomy does not describe level or depth 
of processing jnvolved, it is successful in depicting the relationship 
between the question and the answer; or more specifically, the infor^ 
mat! on used to create a question and the appropriate source of response 
information. This is a step- forward in attempting to investigate prose 
processes . 

A second factor, inserted question response mode and its effect on 
text recall has not been investigated systematically with children. 
Typically students have been asked to respond in a variety of ways-- 
underlining relevant passage information (e.g., Rickards & Oenner, 1979; 
Frase, 1968), providing short answers to open ended * questions (e.g., 
Anaerson & Hyro, 1971); and selecting a response from a set of alter« 
natives (e.g.. Prase, 1968). It has generally been demonstrated that 
the inserted question effect upon text retention is greater when the 
reader is required to supply the answer. Effects are stronger, for 
example, with short-answer inserted questions than with multiple-choice 
inserted questions (Anderson & Biddle, 1975). What is not yet known is 
the response ^node rnobt tdCilitative for children's comprehension. Adult 
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performance is most impruved wnen the inserted question requires an 
overt response as opposed to a coveri: nienta: reponse (Anderson, 1967 ; 
Anderson & Biddle, 1975; Holland & Kemp, 1965; Kemp & Holland, 1966). 
One might infer that the same would be true of children, but given the 
inconcl lisi ve results o^ the effect of adjunct questions witn children 
(e.g., Rickards & Denner, 1979; Rickards & Hatcher, 1978), this remains 
to be demonstrated, 

A third factor, the type of criterion test needs to be examined in 
terms of children's comprehension. Tests have generally been either 
short answer or multiple choice in format, but there have been no stu- 
dies with children comparing performance following inserted questions 
across the two types of examinations. It would seem that certain moaes 
of responding place greater demands on memory than others, with the proba- 
bility mat recognition (multiple choij;e) formats are less demanding 
than recall (essay or short answer) formats. 

The purpose of this study was to examine the effects of inserted 
Question type, response mode, and criterion test format on children's 
comprehension of expository text. Four hypotheses were proposed: (1) 
students performance on the TE, TI , or SI questions on the criterion 
test will vary as a function of the ty^e of inserted question received, 
(2) students responding overtly to the inserted questions will perform 
at a higher level on the criterion test than those responding in a 
covert manner, (3) per t iPance levels w(!ula t)e higner -n the recognition 
than the recall test, and -4) tnat dcross developme^> -.1 or eqe levels, 
patterns of performance will renvnn cG'^'Stant. 
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Method 

Subjects 

Students from neighboring elementary and middle schools participated 
in the study: 97 fourth and 102 eighth grade students. All students 
were drawn from a middle class suburban area and read at or above grade 
level, as measured by reading group placement. 
Materi al s 

The passage selected for use in this study was a 600-word exposi- 
tory passage written on the fourth grade level , the topic (dogs) was 
familiar as indicated by pilot data. Two sets of eighteen questions 
were developed for the passage: one inserted question set and one post- 
reading comprehension set, with six each TE, TI , and SI questions in a 
set. For the post-reading comprehension questions, two versions were 
created. One version in\/^)Vve<l only the .question stems to which the stu-- 
dents would provide short answer responses • The other version involved 
the same stems followed by four alte-^native choices, of which only one 
was correct . 

These materials were combined to form the student test booklets 
which took the following form: the passage was divided into six equiva- 
lent sections, with one inserted question following each section. '^ne 
question referred to information presented in the preceding section. A 
post-reading comprehension test followed the six sections* Tne test 
consisted of six each TE, TI , and SI questions in either tne snort 
answer or the multiple choice format. Each booHet was designated a TE, 
TI, or SI booklet based upon the type of insertea quest^.on it contained; 
that IS, each booklet contained only one type of QA^^ dS inserted 
questions, while d1l tnree que'-t i '^■ri^a'>svsf-^ rt 1 et"^ :- ^ i wnre ^Lv^re- 
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sented in the cc^prehens < on test. 
Design and Procedure 

A 3 X 2 X 2 X 2 mixed f acton a 1 des i gn was created wi tn the 
Detween-suDjects factors of inserted question type (TE, TI, and SI), 
response mode (Overt and Covert), test mode (Recall and Recognition), 
and grade lesel (Fourth and Eighin), and the wi thi n-subjects factor of 
test questior. type (TE, TI, and SI). Students were divided randomly 
among conditions such that the number per ceV. ranged from 7 to 9. 

Students were tested withm classrooms, taking approximately forty- 
five minutes to complete the task. Students were randomly assigned to 
test booklets which consisted of the passage with its inserted questions 
and the comprehension test following the passage. All students were 
told that the purpose of the study was to discover ways to help them 
better understand stories and assignments they had to read in school. 
Tney were also given a brief introduction to the three QARs, designed to 
reduce the level of anxiety that students in the SI condition might nave 
experienced when they were unable to locate response information. 

Following the introduction into QARs, students were instructed to 
read each section of the passage, respond to the question on the page 
'-'ol lowing each section without referring back to the text, proceaing 
through the booklet in this manner until they had completed all six sec- 
tions with their correspond ng questions. Students in the overt con- 
dition were instructed to wnte tne answer on the blank following the 
■nserted qiiestion; students in the covert condition were instructed to 
think coretuily arid as hard as they could of tne response to the 
quest lor^, wnen tneir reading was coiTipleted, they were directeo to the 
Lor.;.rer'prts 1 0^' t^^^t , -;n^>"r.rt.: t:) ^nv^er the ev.^te^jn cufst'ons wit^^^out 
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reference to the passage. Students eitner campletec tne sho^ answer or 
tne njltip1e cnoice version. When the class had finished, a debrief ig 
was prov ded, explaining the study -nore coi^pletely, including the 
variations among tne booklets. 
Scon ng Procedures 

Two scoring procedures were developed: a traditional correct- 
incorrect dichotomous scale was used for the multiple choice test and a 
four-point scar^ was usea for the short answer test. The four-point 
scale ratea responses as (1) an exact or close synonym for the expected 
response, (2) a borderline response (one that would Le correct only in 
tne most lement of ci rcunstances ) , (3) an incorrect response, and (4) a 
response that was undecipherable due to writing or spelling or one that 
had been left blank. Only answers from the first category were accepted 
as correct in the ana>sis. Interrater reliability across four raters 
reached .94. Any disagreements were resolved following a discussion 
among tne judges. 

Resul ts 

A 3 X ? X 2 X 2 mixed analysis of variance assessing the number of 
correct responses on the criterion tests revealed significant main 
effects for grade level, F(l,175) - 50.99, £< *01; test mode, F_(l,175) 
- 117.56, £ < ,01; and test question type, F(2,360) = 15.38, p < .01 
(see Table 1). 
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Tnese r-^.ults were 'brther exp'ainec by three siqnificdnt two-way 
1 ' t er dCt i . ""'^st ^iocJe inieracteo y..tri crcsOf, - 12.^3; p < 
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*01, tne interaction cue to the nagnUude of ihe c^^^ft-reriCe pertor- 
nance of the fourth graae students across the two test modes relative to 
that of the eighth gf^ade students (see Figure 1). 



Insert Figure 1 About Here 



Test mode also interacted significantly with test question type, 
£(2,350) ^ 16*56, £ < .01. Students in the recognition test mode seemed 
equally facile on TE, TI , and SI questions, while students in the recall 
test mode were most successful on the TI questions, less so on the SI 
and TE ( see Fi gure 2) • 



Insert Figure 2 About Here 



The third significant interaction was response mode X grade, F(l,175) 
= 30.59; p < .Ol, Students in the eighth grade performed as predicted; 
these in the overt response condition were more successful than those in 
the covert- However, contrary to predictions and expectations based 
upon adult data, the reverse was true for the fourth grade students (see 
Ficure Si- 
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Di scussion 

To jr predi ct'i ons had Deen proposed dt trie onset of the stud v end 
the J^esults will be discussed m ter^ns of tht^s^; r'__> ;'0t heses , ReCdll that 
tne first r^t-dicti(;n '.t^d t^^t r..-:^^:s' 
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on a specific question type o^^c^id'^nq upon the type of question received 
dunng reading. That is, an inserted question type by test question 
type interaction was expected. That tfiis did not occur may be a func- 
tion of the type of posttest. Since the criterion test assessed tne 
indirect effect of inserted questions, performance on non-target or 
incidental information, the lack of an interaction may be explained m 
terms of the novelty of the information required for an accurate 
response. In fact, Reynolds & Magleby (1981) using the same passage but 
testing for the direct effect on target information did find this 
1 nteract i on . 

The second hypothesis suggested that performance levels when 
required to provide an overt response to the inserted questions would be 
higher than those required to provide a covert response, as suggested by 
the adult data. This is pprhaps one of the most interesting findings of 
the study, because 4th and 8th grade students respond differentially to 
the overt task requirements. The eighth graae students* performance was 
similar to that found with adult populations, suggesting that for the 
older students the overt response induced some greater level of pro- 
cessing of information, focused attention on target information, or 
ensured the required activity on the part of the subjects, such that 
their performance was enhanced. However ^ for the fourth grade students, 
this effect did not occur, and in fact the overt resoonse inhibited 
thev' performance. One explanation could be due to fine motor skill 
aitferences; students at Lhis level are less facile in their writing and 
spelling skills, thus to respond overtly redirected their attention to 
less relevant issues. Another explanation may it one of cognitive capa- 
city. i^erhaps Deir.^ reqiiired to write the exp«d^aLU.r dS well cs held 
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; r,f orndti v^-. f^0'^ the text puts too u^eat a aer^anC on tr-.^r u!r^:^v^' 
Cdpac^iy, iPus :cr f or-fTiance which reflects their comprehens i o"^- ot ''e 
materidi Suffers. By tne tiine the response is deciaec: '.pon d^.i 
'eco^aed, tre overdll ideas in the text are lost. 

T^te ini'-a hypothesis was that performance would be nigher 
recognition than recall tasks. This is precisely what was found, 
though at the fourtn grade level this difference was ?nore pronounced 
than for tne eighth grade studetits. 

Pinal ly, It was hypothesized that patterns would re^Tiain constant 
across the two developmental levels. That this did not occur suggests 
tne '^'eed for ^urther research in the area of adjunct questions^ It 
appears tnat not only are children different from adults, but that one 
can not generalize from one population of students to another. This 
coula De a reason for the equivocal results of the research thus far 
(e.g., RicKards & Denne^, 1 979 ; Swenson & Kulhavey, 1974; Tvickards & 
Hatcher, 1978) which suggest that the effect of inserted questions is 
inconsistent. The fact that all students in this study were reading at 
or above grade level may also have masked effects of inserted questions 
in that it IS assumed that students who are successful readers are 
already organizing and retaining the information presented to them m 
texts . 

Limitations of the Study 
There are several limitations to this study which reduce its 
general 1 zaoi 1 ity and suggest directions for future resedrch. One obvious 
^atn for extension of this work lies m assessing these variables across 
a number of passages , while pilot work and our or-going research tends 
tc *-j;.po''t ^n^ip t ] r^.ii ...^^c ^ thorou'jh investigation of factor'. t>a^. 
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influence comprehension across passages which vary in familiarity and 
difficulty should be considered. Further studies incorporating reading 
ability and age levels should be conducted. In addition, as question 
taxonomies are developed which accurately re^flect both levels of pro- 
cessing and^ the relationship between question, text, and reader *s 
knowledge base; these taxonomies should be applied to inserted question 
research. Finally, since research tends to differ in the effectiveness 
of the inserted question, further research should be conducted comparing 
these variables as they affect performance relative to performance of 
students in a no-qu'festion control group. 
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Table 1 
Main Effects 



Grade 

Fourth 3.66 

Eighth 4.71 
Test Mode 

Recall 3.38 

Recognition 4.8? 

Question Type: Test 

TE 4.34 

TI 4.27 

SI 3.89 
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Figure 1. Grade X Text Mode Interaction 
Figure 2. Text Question QAR X Test Mode Interaction 
Figure 3. Grade X Condition Interaction 
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